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Listing of Claims; 



52. (Currently Amended) A hyperlinked video broadcast 
system including a plurality of multiplexed video streams each 
having a plurality of video frames, said system comprising: 

a mask generator generating a plurality of mask overlays 
corresponding to a plurality of regions in said plurality of 
video frames; and 

a receiver capable — receiving viewer actuation of stream 
GQloction — input — identifying one of said plurality of mask 
overlays oQlcctGd by — a — viewer and switching from presenting to 
said viewer a first one of said plurality of multiplexed video 
streams to presenting to said viewer a second one of said 
plurality of multiplexed video streams in response to said 
viewer actuation otroam ooloction input . 

53. (Currently Amended) The system of claim 52 wherein 
information associated with said viewer actuation otrcam 

oclcction input is reported to a remote location via a 

backchannel communications connection . 
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54. (Previously Presented) The system of claim 52 wherein 
said plurality of mask overlays comprise location and shape 
information of said plurality of regions in said plurality of 
video frames . 

55. (Currently Amended) A hyperlinked video and audio 
broadcast system including a plurality of multiplexed video 
streams each having a plurality of video frames and including a 
plurality of multiplexed audio streams, said system comprising: 

a mask generator generating a plurality of mask overlays 
corresponding to a plurality of regions in said plurality of 
video frames; and 

a receiver capable — e# receiving viewer actuation of stream 
OQlcction — input — identifying one of said plurality of mask 
overlays Gclcctcd by — a viewer and switching from presenting to 
said viewer a first one of said plurality of multiplexed audio 
streams to presenting to said viewer a second one of said 
plurality of multiplexed audio streams in response to said 
viewer actuation otroam oolcction input . 

55. (Currently Amended) The system of claim 55 wherein 

information associated with said viewer actuation stream 

oolQCtion input is reported to a remote location via a 

backchannel communications connections . 

57. (Previously Presented) The system of claim 55 wherein 
said mask overlays comprise location and shape information of 
said plurality of regions in said plurality of video frames. 



-3- 




Appln No, 09/747,677 
Amdt date April 23, 2004 

Reply to Office action of December 23, 2003 



58. (Currently Amended) A hyperlinked video reception 
system including a plurality of input multiplexed video streams 
each having a plurality of video frames, said system comprising: 

a mask presenter rendering a plurality of mask overlays 
corresponding to a plurality of regions in said plurality of 
video frames; 

a receiver receiving otrcam — ocloction — input — from — a viewer 
actuation of specifying a — firot one of — said plurality of — input 
multiplexed video — Gtrcamo — by — idontifying one of said plurality 
of mask overlays, 

wherein said receiver switches from presenting to said 
viewer a second one of said plurality of multiplexed video 
streams to presenting to said viewer a said first one of said 
plurality of multiplexed video streams in response to said 
viewer actuation stream ocloction input . 

59. (Currently Amended) The system of claim 58 wherein- 
information associated with said viewer actuation otrcam - 

selection input is reported to a remote location via a 

backchannel communications connections . 



60. (Previously Presented) The system of claim 58 wherein 
said mask overlays comprise location and shape information of 
said plurality of regions in said plurality of video frames. 

61. (Currently Amended) A hyperlinked video stream 
switching data structure system having a plurality of video 
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streams each including a plurality of video frames said system 
comprising : 

a plurality of video stream identifiers each associated 
with one of said plurality of video streams; 

a plurality of mask overlays corresponding to a plurality 
of regions in said plurality of video frames; 

a first data structure element referenced by a set of said 
plurality of mask overlays; 

a second data structure element referenced by said first 
data structure element, said second data structure element 
containing a reference to a first one of said plurality of video 
streams; and 

a current video stream identifier corresponding to a second 
one of said plurality of video streams; 

wherein actuation ooloction of said one of said plurality 
of mask overlays by a viewer causes said system to make said 
current video stream identifier correspond to said first one of 
said plurality of video streams. 

62. (Previously Presented) The system of claim 61 wherein 
said mask overlays comprise location and shape information of 
said plurality of regions in said plurality of video frames. 

63. (Previously Presented) The system of claim 61 wherein 
said reference to a first one of said plurality of video streams 
references a third data structure element including references 
to an audio stream and a private data stream associated with 
said first one of said plurality of video streams. 
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64. (Currently Amended) A method for switching between 
multiplexed video streams in a hyperlinked video broadcast 
system including a plurality video streams each having a 
plurality of video frames, said method comprising: 

generating a plurality of mask overlays corresponding to a 
plurality of regions in said plurality of video frames; 

receiving viewer actuation of gtroam GclcGtion input 

identifying one of said plurality of mask overlays by a viewer ; 
and 

switching from presenting to said viewer a first one of 
said plurality of multiplexed video streams to presenting to 
said viewer a second one of said plurality of multiplexed video 
streams in response to said viewer actuation Gtroam Gcloction 
input , 

65. (Currently Amended) The method of claim 64 further 
comprising reporting information associated with said viewer 
actuation otrcam — oclQction — input to a remote location via a 
backchannel communications connection. 

^66 . iPreviously Presented) The method of claim 64 wherein 
said plurality of mask overlays comprise location and shape"^ 
information of said plurality of regions in said plurality of 
video frames. 

67. (Currently Amended) A method for switching between 
multiplexed audio streams in hyperlinked video broadcast system 
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including a plurality video streams each having a plurality of 
video frames and including a plurality of audio streams, said 
method comprising: 

generating a plurality of mask overlays corresponding to a 
plurality of regions in said plurality of video frames; 

receiving stream oclcGtion input — from a viewer actuation of 
specifying — a — first — e^e — b€ — said — plurality — ef — input — multiplcxod 
audio — streams — fey — identifying one of said plurality of mask 
overlays; and 

switching from presenting to said viewer a second one of 
said plurality of multiplexed audio streams to presenting to 
said viewer a said first one of said plurality of multiplexed 
audio streams in response to said viewer actuation stream 
selection input . 

68. (Currently Amended) The method of claim 67 further 
comprising reporting information associated with said viewer 
actuation stream selection input to a remote location input via 
a backchannel communications connections. 

69. (Previously Presented) The method of claim 67 wherein 
said mask overlays comprises location and shape information of 
said plurality of regions in said plurality of video frames. 

70. (Currently Amended) A method for switching between 
video streams in a hyperlinked video reception system including 
a plurality of input multiplexed video streams each having a 
plurality of video frames, said method comprising: 
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rendering a plurality of mask overlays corresponding to a 
plurality of regions in said plurality of video frames; 

receiving atrcam oclcction input — from a viewer actuation of 
apccifying — a — f irat — ob^ — — oaid — plurality — a4 — input — multiplc^cod 
video — Gtrcamo — fey — identifying one of said plurality of mask 
overlays ; and 

switching from presenting to said viewer a second one of 
said plurality of multiplexed video streams to presenting to 
said viewer a oaid first one of said plurality of multiplexed 
video streams in response to said viewer actuation otrcam 
ooloction input . 

71. (Currently Amended) The method of claim 70 further 
comprising reporting information associated with said viewer 
actuation atrcam — Gcloction — input to a remote location via a 
backchannel communications connection [e] . 

72. (Previously Presented) The method of claim 70 wherein 
said mask overlays comprises location and shape information of 
said plurality of regions in said plurality of video frames. 

7 3. (Currently Amended) A method for switching between 

hyperlinked video streams in a hyperlinked video stream system 
having a plurality of video streams each including a plurality 
of video frames said method comprising: 

generating a plurality of video stream identifiers each 
associated with one of said plurality of video streams; 
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generating a plurality of mask overlays corresponding to a 
plurality of regions in said plurality of video frames; 

generating a first data structure element referenced by a 
set of said plurality of mask overlays; 

generating a second data structure element referenced by 
said first data structure element, said second data structure 
element containing a reference to a first one of said plurality 
of video streams; 

generating a current video stream identifier corresponding 
to a second one of said plurality of video streams; 

receiving viewer actuation of otrcam oclcGtion input 

identifying said one of said plurality mask overlays; and 

making said current video stream identifier correspond to 
said second one of said plurality of video streams in response 
to said viewer actuation stream Qclcction input . 

74. (Previously Presented) The method of claim 73 wherein 
said mask overlays comprise location and shape information of 
said plurality of regions in said plurality of video frames, 

75. (Previously Presented) The method of claim 73 wherein 
said reference to a first one of said plurality of video streams 
references a third data structure element including references 
to an audio stream and a private data stream associated with 
said first one of said plurality of video streams. 
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76. (New) A hyperlinked video broadcast system including a 
plurality of multiplexed video streams each having a plurality 
of video frames, the system comprising: 

means for generating, in response to a user command, an 
image overlay visually identifying an object in a video frame; 
means for receiving viewer actuation of the image overlay; 

and 

means for switching from presenting to a viewer a first one 
of the plurality of multiplexed video streams to presenting to 
the viewer a second one of the plurality of multiplexed video 
streams in response to the viewer actuation. 

77. (New) The system of claim 76, wherein the image 
overlay is associated with first timing data, presentation of 
the image overlay being synchronized with the video frame based 
on the first timing data. 

78. (New) The system of claim 77 further comprising.; a 
computer-readable medium storing computer program code that 
compares the first timing data with second timing data 
associated with a current video frame and sleeps for a period of 
time equivalent to a difference in times indicated by the first 
and second timing data, the computer program code being awakened 
for visually identifying the object based on the image overlay 
in response to an expiration of the time period. 

79. (New) The system of claim 76 further comprising: 
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a data store storing a data structure including annotation 
data associated with the object, the data structure being 
associated with second timing data indicative of a last instance 
the data structure is used in a video program associated with 
the video frame; and 

means for removing the data structure from the data store 
in response to a determination based on the second timing data 
that the data structure is no longer used in the video program, 

80. (New) The system of claim 79 further comprising: 

means for encoding the data structure and image overlay 
data into a packet stream received by a receiver in the 
hyperlinked video broadcast system, 

81. (New) The system of claim 80 further comprising: 

means for encoding the image overlay data and the data 
structure into a portion of the packet stream that is received 
prior to receipt of a portion of a video signal including the 
video frame . 

82. (New) The system of claim 81, wherein a fixed number 
of packets is allocated to each of a plurality of image overlay 
data sets to be encoded into the packet stream, the f ixed~rram&er 
of packets corresponding to a number of packets filled by a 
largest image data set to be encoded. 
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83. (New) The system of claim 82, wherein a particular 
image overlay data set fills a particular number of packets that 
is less than the fixed number of packets. 

84. (New) The system of claim 83, wherein the data 
structure is encoded into the .packet stream by identifying a 
first occurrence of the object associated with the data 
structure, and moving backwards in time from the first 
identified occurrence and filling one or more unused packets 
allocated to the particular image overlay data set with at least 
a portion of the data structure. 

85. (New) The system of claim 84, wherein the packet 
stream is received with a video stream over a broadcast signal. 

86. (New) The system of claim 84, wherein the packet 
stream is received out-of-band separately from a video stream 
including the video frame. 

87. (New) The system of claim 84, wherein the means for 
generating an image overlay further comprises: 

means for identifying on a first two-dimensional section 
containing a three-dimensional volume, a first region associated 
with the object, the first region including one or more first 
pixels ; 

means for filling the first region including the one or 
more first pixels with a predetermined value; 
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means for moving in a first direction along a third 
dimension to a second two-dimensional section containing the 
three-dimensional volume ; 

means for determining whether a second pixel in the second 
two-dimensional section that corresponds to a filled pixel in 
the first two-dimensional section . belongs to the three- 
dimensional volumes- 
means for filling a second region including the second 
\ pixel in the second two-dimensional section with the 

predetermined values- 
means for returning to the first two-dimensional section; 

and 

means for moving in a second direction along the third 
dimension to a third two-dimensional section containing the 
three-dimensional volume for filling a third region. 

88. (New) The system of claim 87, wherein each two- 
dimensional section is a video frame. 

89. (New) The system of claim 87, wherein the third 
dimension is time. 
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